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SWMARV 
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cspeblllty  thst  provided  e  full  rsnge  of  coaputer*besed  Instruction ''tCBlT^functlons,  Including 
course  developaent  end  presentetlon,  resource  ellocetlon  end  scheduling,  end  Individue)  student 
aenegeaent.  A  unique  festure  wes  the  Adeptive  Node),  which  produced  student  prescriptions  beted 
on  tredeoffs  eaong  leerning  requlreaentt,  student  cherecterlstlcs,  end  resource  evellsbillty.  To 
support  the  Integreted  CBI  systea,  e  h1gher>order  lenguege  celled  CANIL  (Coaputer«Att1tted/ 
Meneged  Instructions)  Lenguege)  wes  deve)oped.  Herdwere  support  wes  provided  by  e  CYBER  73>)6 
computer  with  )0  aenegeaent  teralnels  end  SO  Interective  tera1ne)s.  This  peper  describes  the 
beckground  of  the  AIS,  suaaerizes  the  eveluetlon  dete,  end  discusses  current  efforts  underwey  es 
e  result  of  lessons  leerned  froa  the  AIS  deaonstretlon  progrea.  ^ 
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COMPUTER-BASED  TRAINING:  IMPLEMENTATION 
AND  SYSTEM  EVALUATION 


I.  INTROOUCTION 

Following  a  series  of  prellilnary  studies  In  the  eerly  1970's,  the  United  States  Air  Force 
eabarked  on  a  aajor  research  and  developaent  effort  to  design,  deawnstrate,  and  evaluate  a 
coaputer-based  Instructional  system  at  a  aajor  technical  training  center.  The  system,  called  the 
Advanced  Instructional  System  (AIS),  was  developed  to  demonstrate  the  feasibility  of  managing  and 
adalnistering  Individualized  Instruction  for  up  to  2,000  students  dally  In  four  technical 
training  courses.  A  major  state-of-the-art  advancement  was  an  Integrated  computer-based  support 
capability  that  provided  a  full  range  of  computer-based  Instruction  (C8I)  functions.  Including 
course  development  and  presentation,  resource  allocation  and  scheduling,  and  Individual  student 
management.  A  unique  feature  was  the  Adaptive  Model,  which  produced  student  prescriptions  based 
on  tradeoffs  among  learning  requirements,  student  characteristics,  and  resource  availability.  To 
support  the  Integrated  CBI  system,  a  higher-order  language  called  CAMIL  (Coiqputer-Asslsted/ 
Managed  Instructional  Language)  was  developed.  Hardware  sun>ort  was  provided  by  a  CYBER  73-16 
computer  with  10  management  terminals  and  50  Interactive  terminals.  The  purpose  of  this  paper  Is 
to  describe  the  background  of  the  AIS.  summarize  the  evaluation  data,  and  discuss  current  efforts 
underway  as  a  result  of  lessons  learned  from  the  AIS  demonstration  program. 


II.  BACKGROUND 

Descriptions  of  the  genesis  of  the  AIS  and  of  the  total  concept  are  available  elsewhere 
(Nunns.  1982;  Rockway  4  Yasutake,  1974).  A  brief  description  of  the  program  Is  presented  In  the 
following  paragraphs. 

Four  technical  training  courses  were  chosen  to  demonstrate  the  AIS  capabilities:  Inventory 
Management  (IM),  Materiel  Facilities  (MF),  Precision  Measuring  Equipment  (PME),  and  Weapons 
Mechanic  (NM)  courses.  These  courses  represented  approximately  1.500  hours  of  Instruction  and 
were  selected  because  of  the  differences  In  course  lengths,  training  content,  technical 
complexity,  and  student  aptitude  requirements,  plus  the  fact  that  they  were  relatively  high-flow 
courses.  During  the  demonstration  period,  the  four  courses  had  a  student  flow  of  approximately 
7,000  per  year. 

Prior  to  the  AIS  program,  these  courses  were  taught  In  a  conventional  group-paced  classroom 
environment.  As  the  AIS  segments  were  Implemented,  the  classrooms  were  converted  to  learning 
centers  with  a  variety  of  self-paced  Instructional  nwterlals.  The  role  of  the  training  cadre  was 
changed  from  that  of  platform  Instructors  to  learning  center  managers  and  training  facilitators. 

Self-paced  Instructional  materials  were  developed  to  replace  conventional  classroom 
Instruction.  For  approximately  25%  of  the  course  content,  optional  tracks  were  developed.  Some 
options  used  different  presentation  modes  (e.g.,  printed  texts  and  audiovisual  presentation), 
while  others  differed  In  the  strategy  of  presentation  (e.g.,  the  amount  of  redundancy).  It  was 
the  availability  of  these  options  that  allowed  a  test  of  the  effectiveness  of  the  Adaptive  Mode). 

Computer  support  was  provided  by  a  Control  Data  Corporation  (CDC)  CYBER  73-16  with  10 
management  terminals  (each  consisting  of  a  document  reader,  printer,  and  minicomputer)  and  50 
Interactive  teimlnals  (plasma  display  and  keyboard).  A  primary  component  of  the  software  was 
CAMIL  (Computer-Assisted/Managed  Instructional  Language),  a  higher-level  language  specifically 
designed  to  facilitate  both  computer-managed  Instruction  (CMI)  and  computer-assisted  instruction 
(CAI)  using  a  common  Integrated  data  base. 
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The  configuration  of  the  AIS  at  the  tiae  of  systea  evaluation  was  essentially  that  of  a 
1arge*sca1e,  self-paced  CMI  (SP/CMl)  systea.  The  CMI  capabilities  Included  standard  features 
such  as  test  scoring  and  analysis,  student  rosters,  student  progress  records,  and  various  course 
evaluation  reports.  In  addition,  two  aajor  unique  features  were  designed  and  evaluated  as  to 
their  effectiveness  In  enhancing  training.  The  first  was  the  Individualized  Instructional 
assignaent  (IIA)  capability  and  the  second,  the  student  progress  aanageaent  (SPN)  systea.  In 
brief,  the  IIA  provided  each  student  with  a  specific  prescription  for  the  next  sequence  of 
Instruction.  The  prescription  was  driven  by  a  heurlstically  based  Adaptive  Model.  A  slapllfled 
diagraa  of  the  priaary  coaponents  of  the  aodel  Is  provided  In  Figure  I.  IIA  selected  an 
Instructional  sequence  (froa  available  alternatives)  that  was  predicted  to  aaxlalze  student 
perforaance.  Input  data  Included  past  perforaance,  student  characteristics,  and  resource  and 
lesson  availability. 


Figure  1.  Adaptive  Model . 


The  SPM  capability  maintained  records  of  the  rate  of  student  progress  and  produced  predicted 
completion  times  for  segments  of  training,  as  well  as  for  the  entire  course.  Each  student  was 
able  to  track  his/her  own  progress  and  to  establish  Individual  goals  to  meet  the  predicted 
completion  time.  Predictions  were  based  on  student  aptitude,  past  performance,  and  historical 
data  on  past  students  with  similar  profiles.  When  necessary  because  of  extraneous  circumstances 
(e.g..  Illness),  Instructors  were  able  to  revise  the  computer-generated  predictions. 


III.  EVALUATION  OF  ADVANCED  INSTRUCTIONAL  SYSTEM 


Issues  In  Evaluations  of  Large-Scale  Systems 

A  well -control  led  evaluation  of  a  large-scale  system  represents  a  particularly  difficult  task 
because  of  real-world  constraints.  Initially,  consideration  was  given  to  freezing  the  content  of 
the  four  courses  during  the  AIS  demonstration  and  test  phase  and  to  having  a  parallel  control 
group  (conventional  classroom)  and  an  experimental  group  (SP/CMI)  within  each  course.  In  this 
manner.  It  would  have  been  possible  to  Introduce  various  conditions  In  the  experimental  group  and 
to  compare  outcomes  with  the  control  group.  However,  real-world  limitations  (e.g.,  facilities 
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and  equlpaent)  precluded  such  an  approach.  Rather,  a  decision  was  made  to  use  a  ‘‘pre*  and  “post* 
paradise.  Thus,  for  each  course,  'pre*  data  were  collected  on  course  length,  attrition  rates, 
test  scores,  and  field  supervisor  ratings  for  a  1-year  period  prior  to  AIS  1q>1enentat1on.  These 
data  served  as  a  baseline  for  conparlsons  with  data  gathered  after  AIS  segments  were 
Implemented.  Although  this  approach  was  followed  to  the  extent  possible,  changes  In  field 
requirements  during  the  course  of  the  demonstration  dictated  changes  to  training  content.  Thus, 
an  Issue  of  comparability  of  the  pre-  and  post-course  versions  needed  to  be  resolved.  This  Issue 
was  handled  by  carefully  analyzing  course  content  of  the  two  versions  (I.e.,  conventional  and 
AIS)  and  making  comparisons  only  with  subsets  of  the  courses  which  were  connn  to  both. 


Evaluation  Aoproadi  and  Results 

From  the  beginning  of  operations  to  the  completion  of  the  formal  system  evaluation,  more  than 
20,000  students  were  graduated  from  the  SP/CMI  courses.  Two  major  categories  of  evaluation  data 
were  collected  during  this  time.  In  the  first  category  were  the  recurring  and  periodic 
assessments  of  training  effectiveness  as  measured  by  student  time  savings,  achievement,  student 
and  Instructor  attitudes,  and  field  supervisor  ratings.  These  data  were  gathered  systematically 
over  a  3-year  period  to  determine  the  extent  to  which  Instruction  was  functioning  to  meet  stated 
training  goals.  The  second  major  category  of  evaluation  was  the  Integrated  Systems  Test  (1ST). 
Of  particular  Interest  during  this  test  was  the  effectiveness  of  the  IIA  and  SPH  capabilities. 
Extensive  data  were  also  gathered  regarding  the  reliability  of  computer  hardware  and  software. 
The  Intent  was  to  ensure  that  the  contractual  specification  under  which  the  AIS  was  developed  had 
been  met. 


Training  Effectiveness  Evaluation 

Four  separate  Indices  were  used  to  assess  the  effectiveness  of  training:  (a)  student 
training  time  savings,  (b)  achievement  on  paper-and-pencll  tests,  (c)  student  attrition  rates, 
and  (d)  field  supervisor  rating  of  the  adequacy  of  training  to  meet  Job  requirements.  These  data 
were  collected  at  various  times  during  the  4  years  that  the  AIS  demonstration  was  In  effect. 

Student  Time  Savings.  Calculations  of  savings  In  student  time  were  made  based  on  the  extent 
to  which  students  met  criterion  under  SP/CMI  versus  conventional  Instruction.  Calculations  were 
made  only  on  those  segments  of  the  course  that  were  common  to  both.  Table  1  shows  the  time 
savings  for  each  of  the  four  courses.  As  can  be  seen,  time  savings  ranged  from  24t  to  351. 


Table  1.  Student  Time 
SavIngs-SP/CMI 


Course _ I  Saving 


IN 

35 

NF 

24 

UM 

31 

PME 

31 

Paper-and-Pencll  Test  Scores  Within-course  achievement  was  measured  by  comparing  test  scores 
for  Instructional  content  common  to  both  pre-  and  post-AIS  Implementation.  Because  of  the 
difficulties  In  determining  test  Item  coomonallty,  data  were  compared  only  for  the  IM  course. 
Results  shown  In  Table  2  Indicate  that  test  achievement  under  the  pre-  and  post-conditions  was 
quite  similar. 


Table  2.  Conventional  vs 
SP/CMI  Test  Scores 


Block 

Conventional 

t 

SP/CMI 

S 

1 

82 

89 

2 

83 

83 

3 

84 

87 

4 

80 

84 

5 

83 

87 

Student  and  Instructor  Attitudes.  After  completion  of  the  course,  each  student  completed  a 
40>1tem  attitude  questionnaire.  The  questionnaire  was  designed  to  assess  attitudes  toward 
various  aspects  of  the  SP/CMI-supported  Instruction.  On  two  occasions.  Instructor  attitudes  were 
also  measured.  In  general,  80S  to  90t  of  the  students  reacted  favorably  to  their  experiences. 
In  contrast.  Instructors  were  generally  negative.  An  Interesting  comparison  between  Instructor 
and  student  attitudes  toward  similar  Items  1$  depicted  In  Table  3.  These  findings  are  In  general 
agreement  with  those  of  other  studies  (Carson  et  a1.,  1975;  Seidel,  Rosenblatt,  Wagner,  Schulz,  & 
Hunter,  1978). 

Table  3.  Student  (S)/Inttructor  (I)  Attitudes 

Student  question 

Attitude* 

S 

(N-363) 

% 

I 

(M-46) 

S 

Instructor  question 

(Compared  to  conventional 

Instruction) 

Compared  to  lecture,  self* 

D 

15 

57 

*  Students  learn  as  well  under 

paced  course  Is  better  way 

N 

28 

22 

self-pacing. 

to  learn. 

A 

56 

22 

The  Instructor  was  available 

0 

6 

30 

Under  self-pacing,  I  have  less 

whenever  I  needed  him. 

N 

9 

30 

time  to  spend  with  students. 

A 

85 

39 

Prefer  future  AF  courses  to 

0 

14 

59 

Students  seem  to  like  self- 

be  of  this  type. 

N 

26 

26 

pacing. 

A 

60 

15 

The  programmed  Instruction 

0 

56 

13 

Self-paced  materials  are 

was  boring. 

N 

31 

28 

boring. 

A 

13 

59 

*0  •  Disagree. 
N  •  Neutral. 

A  •  Agree. 


Acadeeic  Attrition.  Although  data  on  attrition  were  collected.  It  was  recognized  that  they 
were  not  necessarily  Indicative  of  Instructional  quality.  Various  factors,  such  as  field  demands 
and  changes  In  student  quality.  Influence  attrition.  Nevertheless,  the  data  were  collected  to 
detemlne  whether  any  unexplained  fluctuations  occurred  after  AIS  Implenentatlon.  Table  4, 
adapted  from  the  Orlansky  and  String  (1981)  report,  shows  that  after  an  Initial  decrease,  there 
was  a  trend  toward  increased  attrition. 


It  Is  Interesting  to  note,  however,  that  during  the  same  tine  period,  attrition  rose  In  a11 
courses  being  taught  at  the  training  base. 


Table  4.  Academic  Attrition  Percent 


Courses 

Pre-SP/CNI 

SP/CMI 
year  1 

IM 

1.2 

.7 

1.4 

3.0 

MF 

3.7 

1.8 

3.2 

2.7 

WN 

1.6 

1.6 

3.9 

4.5 

PME 

16.5 

10.8 

6.4 

15.3 

All  Other 
Courses 

4.0 

2.8 

3.0 

4.5 

Field  Supervisor  Ratings.  Approximately  6  months  after  students  completed  training, 
foUow-up  questionnaires  were  sent  out  to  the  field  to  obtain  supervisor  opinions  of  the 
performance  of  graduates.  Table  5  shows  the  results.  The  data  Indicated  that  supervisor  ratings 
were  favorable  regarding  the  performance  of  the  graduates  of  the  SP/CNI  courses. 


Table  S.  Field  Supervisor  Rating  of  Performance 


Rating^ 

m 

(N-310) 

% 

HF 

(N>235) 

S 

PME 

(N-78) 

% 

WM 

(N-147) 

% 

E 

29  (27)^ 

25  (21) 

45  (13) 

18  (15) 

VS 

38 

39  (48) 

26  (31) 

31  (35) 

S 

28  (72) 

33  (28) 

19  (52) 

47  (  50) 

M 

4 

2 

9  (  2) 

5 

U 

1  (  1) 

1  (  3) 

1  (  2) 

_ 0  (  1) 

*E  ■  Excellent. 

VS  *  Very  Satisfactory. 

S  ■  Satisfactory. 

H  ■  Marginal. 

U  *  Unsatisfactory. 

*’Pre-SP/CMI  Graduate  Evaluation. 


Integrated  Systems  Test 

As  may  be  recognized,  the  training  time  savings  discussed  previously  could  In  large  part  be 
attributed  to  the  Instructional  design  process  In  self-pacing  the  four  courses.  A  major  goal  of 
the  AIS  demonstration  was  to  determine  whether  Individualized  Instruction  (I.e.,  prescribing 
Instruction  based  on  Individual  difference  measures)  could  enhance  training.  Thus,  the 
Integrated  Systems  Test  (1ST)  was  designed  to  determine  the  extent  to  which  using  the  Adaptive 
Model  for  IIA  and  setting  Individual  goals  by  use  of  the  SPM  capability  could  contribute  to  time 
savings  above  and  beyond  those  attributable  to  SP/CMI. 

A  more  detailed  account  of  the  1ST  may  be  found  In  a  report  by  Lintz,  Pennell ,  and  Yasutake 
(1979).  The  discussion  here  Is  focused  on  the  two  major  experimental  Issues;  namely,  the 
effectiveness  of  the  IIA  and  the  SPM.  The  IM  course  served  as  the  main  vehicle  for  Investigation 
of  the  IIA.  Data  on  SPM  were  collected  for  all  four  courses. 


Condition 

Single-Track 


CHI  i  sm 

c 


A* 


IIA _ B _ 0 

^Condition  A  -  SP/CMI  version  of  the  course  with  a 
predetermined  sequence  of  Instruction. 

Condition  B  -  assigned  modules  which  were  ‘best*  for 
that  student  based  on  personal 

characteristics  and  past  achievements. 
‘Best*  was  defined  as  the  module  that 
could  be  passed  successfully  In  the 
shortest  time. 


Condition  C  -  the  same  as  A,  except  that  students  were 
given  target  completion  times  and  a 
chart  to  track  their  dally  progress 
toward  that  target. 

Condition  0  -  the  same  as  B  with  SPM  added. 


Table  7  shows  the  results.  The  data  Indicated  that  approximately  3X  above  and  beyond  the 
savings  due  to  SP/CHI  could  be  attributed  to  IIA  where  students  were  given  alternate 
Instructional  segments  as  a  function  of  their  Individual  characteristics.  An  additional  7t  to 
lot  savings  were  attributable  to  the  SPN  system,  which  established  differential  course  completion 
targets  for  Individual  students  as  a  function  of  their  background  and  aptitude.  Although  both  of 
these  figures  are  statistically  significant,  whether  they  are  practically  significant  may  be 
questionable  M.e.,  whether  It's  operationally  effective  to  add  Individualized  assignments  and 
student  progress  management  to  a  self-paced  course). 


Table  7.  Time  Savings 


Condition 

Course 

Phase  I 

SP/CNI 

X  Savinos 

Phase  II 
SP/CNI^PM 
X  Savinas 

Single- 

m 

(Basel  Ine 

10 

Track 

NF 

data) 

6 

WH 

13 

AW 


,  . -  .  _ 


It  was  disappointing  that  the  Mgnitude  of  the  IIA  evaluation  findings  was  not  greater, 
although  these  results  Might  have  been  expected  due  to  the  nature  of  the  experlamtal 
conditions.  At  any  rate,  the  research  coaaunlty  still  has  auch  to  learn  about  the  transition  of 
research  findings  regarding  Individual  differences  froa  carefully  controlled  saall-scale 
experlaents  to  large-scale,  dynaalc,  real-world  environaents. 


IV.  LESSONS  LEARNED 

As  a  result  of  the  experiences  froa  the  developaent,  deaonstratlon,  and  evaluation  of  the 
AIS,  several  observations  can  be  Identified  as  "lessons  learned."  Soae  are  reaffiraatlons  of 
findings  froa  other  similar  experiences. 


Instructional  Aspects 

Mell -designed  self-paced  materials  can  provide  training  equivalent  to  that  of  conventional 
classroom  Instruction,  In  less  time.  Self-paced  materials  provide  variety  In  Instructional 
presentation  techniques  (e.g.,  use  of  multimedia)  and  have  a  mixture  of  learning  activities  to 
sustain  student  Interest. 

The  state  of  knowledge  regarding  Individual  differences  Is  still  not  advanced  enough  to  have 
practical,  significant  Impact  on  design  of  Instruction.  The  computer  software  necessary  to 
execute  a  sophisticated  model  of  adaptive  Instruction  carries  a  considerable  cost  In  terms  of 
system  complexity.  Further  research  Is  essential  to  make  Individualized  Instruction  more  cost 
effective. 

Instructional  goal  setting  Is  .a  very  powerful  motivational  mechanism  and  can  Impact  learning 
progress  considerably. 

The  cost  of  self-paced  Instruction  lies  more  In  the  Instructional  design  and  revision  process 
than  In  Instructional  delivery.  More  efficient  authoring  capabilities  and  Instructional 
developaent  procedures  are  needed. 


Organizational  Aspects 

The  transition  of  a  non-conventlonal  Instructional  system  Into  an  operational  environment  Is 
a  very  complex  process.  Many  factors.  Including  ounagement  and  Instructor  commitment  and 
administrative  and  logistics  support  mechanisms,  are  critical  for  sustaining  a  new  system.  The 
developing  agency  needs  to  serve  as  a  transition  agent  considerably  beyond  the  system  development 
phase.  Further  study  Is  required  to  Investigate  the  factors  required  to  enhance  transition  of 
new  systems  Into  existing  environments  (McCombs,  Back,  S  West,  1984). 

Instructor  roles  are  changed  dramatically  under  self-pacing.  The  selection  and  training  of 
Instructors  and  redefinitions  of  Instructor  roles  In  self-paced  Instructional  environments 
require  further  study. 


V.  CURRENT  RESEARCH  AND  DEVELOPMENT  EFFORTS 

During  the  4-year  demonstration  period,  more  than  20,000  students  were  graduated  from  the 
four  AIS  courses,  with  training  time  savings  representing  more  than  1,500  workyears.  In  terms  of 
cost-avoidance,  the  training  time  savings  helped  to  amortize  the  cost  of  system  development. 
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Although  the  training  effectiveness  data  were  largely  favorable,  questions  regarding  the  costs 
associated  with  a  large  nlnfraae  approach  led  to  a  decision  not  to  lapleaent  AIS  as  an 
operational  systea.  but  to  explore  aore  cost-effective  alternatives  for  future  use.  There  was 
wide  recognition  of  the  powerful  C8I  capabilities  existing  In  the  AIS  software  and  the  fact  that 
this  capability  should  be  captured  using  a  aore  aodularlzed  and  transportable  approach.  The  aore 
recent  advances  In  coaputer  hardware/software  technology  and  particularly  the  eaergence  of 
alnicoaputers  and  alcrocoaputers  have  aade  such  an  approach  technically  feasible.  These 
advances,  together  with  aany  of  the  lessons  learned  froa  past  efforts,  have  guided  the  direction 
of  auch  of  the  aore  recent  and  current  efforts  In  m  research  and  developaent. 


Instructional  Support  Software 

The  developaent  of  the  Instructional  support  software  (ISS)  was  Initiated  In  1982.  The 
functional  requireaents  for  ISS  were  established  as  a  result  of  a  review  of  the  basic  AIS 
capabilities  and  a  survey  of  000  agencies  to  Identify  apy  additional  capabilities  that  were 
viewed  as  being  desirable.  The  approach  was  to  aake  ISS  aodular  and  transportable  to  a  wide 
range  of  alnlcoaputer  and  alcrocoaputer  configurations  using  Ada,  the  standard  000  language.  The 
Intent  In  Modularizing  the  functional  capabilities  was  to  allow  specific  subsets  (e.g.,  CAI,  CMI, 
graphics,  resource  allocation,  and  course  authoring)  to  be  executed  separately  or  together  as  a 
totally  Integrated  systea.  The  basic  ISS  Is  now  coapleted  and  running  on  a  Vax  11/780  coaputer 
systea.  Oeaonstratlon  of  the  capability  of  specific  subsets  of  the  ISS  to  execute  on  a 
alcrocoaputer  has  also  been  coapleted.  Both  capabilities  are  now  under  operational  test.  Once 
the  ISS  Is  stable.  It  Is  anticipated  that  It  will  be  a  part  of  a  standard  OOD  C8I  capability.  A 
further  description  of  the  ISS  nay  be  found  In  a  paper  by  Marshall  (1983). 


Coaputer-Asslsted  Instruction  Han<l>oek 

Often,  training  Managers  are  faced  with  the  Issue  of  whether  CAI  Is  appropriate  for- their 
particular  training  situation.  To  assist  then  In  asking  Infomed  decisions,  a  CAI  hanifcook  was 
recently  coapleted  (Kenner-RIchardson,  Laaos,  B  West,  1985).  Ihls  handbook  provides  an 
Introduction  to  the  concept  of  CAI,  describes  various  factors  to  be  considered,  and  provides 
decision  aids  to  assist  users  In  systenatically  analyzing  their  requireaents. 


Personnel  Roles  In  Non-Convewtional  Instruction 

Past  experiences  clearly  Indicate  the  need  to  redefine  the  role  of  the  Instructional  cadre  In 
non-conventlonal  Instructional  (NCI)  environnents.  A  study  analyzed  such  requireaents  and 
developed  reconnendatlons  for  an  Instructor  training  curriculun  (McConbs  t  Lockhart,  1984).  In 
brief,  the  Ideal  role  for  an  NCI  Instructor  was  detemlned  to  be  that  of  a  counselor,  nodeler, 
evaluator,  diagnostician,  renedlator,  laplenentor,  and  planner. 


Autoaated  Task  Analysis  Authoring  Aid 

Task  analysis  as  the  front  end  of  the  Instructional  Systens  Developaent  process  Is  a 
necessary,  yet  often  tedious,  requirenent.  Several  efforts  have  been  acconpllshed  to  provide 
analysts  with  various  aids  to  assist  In  their  Job.  The  Autoaated  Task  Analysis  Authoring  Aid  Is 
an  Initial  atteapt  based  on  procedures  developed  by  DeVries,  Eschenbrenner,  and  Ruck  (1980)  to 
provide  an  Interactive,  nenu-driven  systea  for  conducting  task  analysis  on-line.  The  Intent  Is 
to  facilitate  tinely  task  analysis  by  using  coaputer  support.  Prel Ininary  Indications  are  that, 
with  continued  Inproveaents ,  the  aid  will  be  very  useful. 
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Recently  AFHRL  hes  Initleted  <  systeaetlc  )ong-renge  reieerch  end  deveTopMnt  thrust  to 
Investigete  the  potentlel  of  ertificlel  Intelligence  to  Job  aiding  and  training.  Current  efforts 
are  Involved  In  prellMlnary  Investigations  of  expert  systeis  and  the  establlshMnt  of  an 
Intelligent  Coaputer-Asslsted  Instruction  (ICAI)  tcst«bcd.  It  Is  anticipated  that  these  efforts 
will  eventually  lead  to  the  developaent  of  a  portable  ICAI  systea. 


VI.  CONCLttSIORS 

Coaputer«based  Instruction  In  alTItary  applications  has  been  deaonstrated  to  be  a  viable  and 
effective  alternative  and  suppleaent  to  aore  traditional  aeans  of  training.  The  early  proalse  of 
Its  potential  Is  reaching  fruition.  Vet,  there  are  still  aany  Issues  to  be  resolved  and  new 
applications  to  be  explored  before  Its  capabilities  are  fully  exploited.  A  great  challenge  still 
reaalns  for  the  research  coaaunity  In  this  area. 
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